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A  TECHNIQUE  EOR  FEATURE  LABELING  IN  INFRARED  OCEANOGRAPHIC  IMAGES 


*  * 
N.  Krishnakumar  ,  S.Sitharama  Iyengar 
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ABSTRACT 

Thermal  infrared  images  of  the  ocean  obtained  from 
satellite  sensors  are  widely  used  for  the  study  of  ocean  dynam¬ 
ics.  The  derivation  of  mesoscale  ocean  information  from 
satellite  data  depends  to  a  large  extent  on  the  correct  interpre¬ 
tation  of  infrared  oceanographic  images.  The  difficulty  of  the 
image  analysis  and  understanding  problem  for  oceanographic 
images  is  due  in  large  part  to  the  lack  of  precise  mathematical 
descriptions  of  the  ocean  features,  coupled  with  the  time  vary¬ 
ing  nature  of  these  features  and  the  complication  that  the  view 
of  the  ocean  surface  is  typically  obscured  by  clouds,  some¬ 
times' almost  completely.  Towards  this  objective,  the  present 
paper  describes  a  technique  that  utilizes  a  non  linear  proba¬ 
bilistic  relaxation  method  for  the  oceanographic  feature  label¬ 
ing  problem.  A  unified  mathematical  framework  that  helps  in 
solving  the  problem  is  presented.  This  paper  highlights  the 
advantages  of  using  the  contextual  information  in  the  feature 
labeling  algorithm.  The  feature  ’abeling  technique  makes  use 
of  a  new,  efficient  edge  detection  algorithm  based  on  cluster 
shade  texture  measure.  This  new  algorithm  is  found  to  be 
more  suitable  for  labeling  the  mesoscale  features  present  in 
the  oceanographic  satellite  images.  The  paper  presents  some 
important  results  of  the  series  of  experiments  conducted  at 
Remote  Sensing  Branch,  NORDA  on  the  NOAA  AVHRR 
imagery  data.  The  paper  concludes  with  a  motivation  for  using 
this  technique  to  build  an  oceanographic  expert  system. 

Key  words:  feature  labeling,  feature  extraction,  oceanic 
features,  edge  detection,  knowledge  based  systems,  relaxation, 
infrared  imagery. 


1.0  INTRODUCTION 

Satcllite-bome  sensors  potentially  offer  many 
advantages  for  the  study  of  oceanic  processes.  They 
provide  global  synoptic  measurements  of  various 
oceanic  surface  properties,  in  contrast  to  the  local 
measurements,  possibly  at  a  range  of  depths,  pro¬ 
vided  by  conventional  oceanographic  measurement 
techniques.  Thermal  infrared  images  of  the  ocean 
obtained  from  satellite  sensors  arc  widely  used  for 
the  study  of  ocean  dynamics.  Fig.  1  shows  a  sample 
infrared  image  of  the  Gulf-Stream  obtained  from  the 
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Advanced  Very  High  Resolution  Radiometer 
(AVHRR)  aboard  the  NOAA-7  satellite.  Brightness 
in  this  infrared  image  is  inversely  proportional  to  the 
ocean  surface  temperature  (dark  areas  represent 
warmer  temperatures  and  light  areas  represent  colder 
temperatures).  Vortices  (areas  of  closed  circulation) 
within  this  turbulent  flow  pattern  are  called  eddies. 
The  Gulf  Stream  and  its  associated  eddies  are  exam¬ 
ples  of  mesoscale  features  ("mesoscale"  is  the  name 
commonly  applied  to  the  features  existing  on  spatial 
scales  of  the  order  of  50  to  300  km).  Mesoscale 
features  are  important  to  the  study  of  ocean  dynam¬ 
ics,  the  fisheries  and  to  many  other  diverse  interests. 

Current  image  analysis  techniques  rely  on  human 
interpretation  of  the  satellite  imagery.  Human 
interpretation  is  obviously  varied  in  its  level  of 
expertise  and  is  highly  labor-intensive.  With  the  prol¬ 
iferation  of  high  volume  Advanced  Very  High  Reso¬ 
lution  Radiometer  image  applications  ,  it  becomes 
highly  desirable  for  certain  applications  to  move 
from  the  labor-intensive  manual  interpretation  of 
infrared  imagery  towards  a  capability  for  automated 
interpretation  of  these  images.  The  complete  automa¬ 
tion  of  the  oceanographic  image  interpretation  func¬ 
tion  is  probably  not  feasible,  but  one  can  begin  to 
address  certain  subsets  of  the  problem  with  the 
present-day  image  processing  and  artificial  intelli¬ 
gence  techniques.  This  was  the  motivation  for  the 

work  reported  by  Lybanon  et  al.,  [1|  [15],  in  the 
development  of  a  prototype  oceanographic  expert 
system. 

Several  previous  studies  have  addressed  the 
automation  of  the  analysis  of  the  infrared  satellite 
imagery  for  mesoscale  features.  Gerson  and  Gabroski 
[2]  and  Gerson  et  al.,[3]  investigated  the  detection  of 
the  Gulf  Stream  in  infrared  images  from  the  Geosta¬ 
tionary  Operational  Environmental  Satellite  (GOES). 
Gerson  and  Gabroski  [2],  used  a  hierarchical 
approach  where  16x16  pixel  (128x128  km)  "frames 
within  the  image  were  evaluated  for  the  possibility  of 
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containing  the  Gulf  Stream.  Frames  flagged  as  Gull 
Stream  possibilities  were  then  further  evaluated  to 
determine  the  exact  location  of  tire  Stream  within  the 
frame  by  looking  at  statistics  based  on  5x5  pixel 
"local  neighborhood".  As  an  outgrowth  of  the  work 
reported  in  [2]  and  [31,  Coulter  [4|  performed 
automated  feature  extraction  studies  using  the  higher 
resolution  Advanced  Very  High  Resolution  Radiom¬ 
eter  data.  Janowitz  (5J  studied  the  automatic  detec¬ 
tion  of  the  Gulf  Stream  eddies  using  the  Advanced 
Very  High  Resolution  Radiometer  data.  Nichol  [6] 
uses  a  region  adjacency  graph  to  define  spatial  rela¬ 
tionships  between  elementary  connected  regions  of 
constant  gray  level  called  atoms.  Eddy-likc  structure 
is  then  identified  by  searching  the  graph  for  isolated 
atoms  of  high  temperature  that  are  enclosed  by  atoms 
of  lower  temperature  (for  the  case  of  warm  eddies). 
Although  satisfactory  emulation  of  human  extraction 
of  eddy  structure  is  claimed  tor  this  method, 
Nichol(6]  does  point  out  that  not  all  enclosed  uniform 
areas  identified  by  the  method  will  correspond  to  real 
ocean  structure. 


2.0  MOTIVATION  OF  THE  PRESENT  WORK 

In  this  section  we  present  the  motivation  behind 
the  present  work.  Our  primary  objective  is  to  build  a 
powerful  automatic  image  interpretation  system  for 
oceanographic  satellite  images.  In  order  to  make  this 
difficult  problem  tractable,  we  divide  the  problem 
into  two  parts  :  feature  labeling  problem  and  the 
development  of  an  expert  system.  In  this  paper  we 
focus  on  the  feature  labeling  problem.  It  is  clear  that 
the  performance  of  the  labeling  algorithm  depends 
heavily  on  the  low  level  image  processing  algo¬ 
rithms.  Particularly,  the  output  of  an  edge  detector 
algorithm  plays  a  major  role  in  the  feature  labeling 
process.  In  view  of  this,  a  new  efficient  edge  detector 
algorithm  proposed  by  Holyer  and  Peckinpaugh  [7]  is 
employed  in  our  feature  labeling  technique.  It  is 
known  that  the  conventional  edge  derivative  opera¬ 
tors  are  very  sensitive  to  noise  and  are  not  suitable 
for  analyzing  oceanographic  satellite  images.  Tire 
new  edge  detector  algorithm  proposed  by  Holyer  and 
Peckinpaugh  [7)  is  based  on  the  gray  level  co¬ 
occurrence  matrix,  which  is  commonly  used  in  image 
texture  analysis.  This  algorithm  [7]  is  found  to  exhi¬ 
bit  the  characteristics  of  fine  structure  rejection  while 
retaining  edge  sharpness.  In  this  paper  we  focus  on 
the  preliminary  results  of  a  feature  labeling  algorithm 
and  the  effect  of  the  cluster  shade  edge  detector  algo¬ 
rithm  on  the  performance  of  the  labeling.  In  the  fol¬ 
lowing  paragraph  we  briefly  outline  the  various  steps 
taken  to  solve  the  second  sub  problem. 


The  objective  of  an  expert  system  tor  oceano¬ 
graphic  system  is  to  correctly  interpret  the  dynamics 
of  the  ocean  process  with  minimal  human  interaction. 
Towards  this  objective,  the  development  of  a  power¬ 
ful  oceanographic  expert  system  is  in  the  process  of 
development  at  Remote  Sensing  Branch.  NORDA 
We  have  already  developed  a  prototype  expert  sys¬ 
tem  for  Gulf  Stream  regional  dynamics  [1|.  Hie 
current  activities  focus  on  building  an  expert  system 
that  makes  use  of  the  information  about  the  position 
of  mesoscale  features  obtained  from  the  relaxation 
labeling  scheme.  One  element  of  an  expert  system  is 
a  database  of  knowledge  about  the  subject  matter, 
with  the  knowledge  represented  in  a  form  suitable  lor 
manipulation  by  the  "inference  engine"  of  the  expert 
system  (i.e.,  the  logical  and  heuristic  procedures  for 
solving  problems  in  the  problem  domain).  With  the 
help  of  the  knowledge  gained  from  discussions  at 
NORDA  and  from  the  literature  in  oceanography,  a 
knowledge  base  about  the  nature  of  the  mesoscale 
features  (occurrence,  mean  life  time,  movement,  etc.) 
was  built  [1],  Presently,  we  are  in  the  process  of 
designing  an  expert  system  which  makes  use  of  the 
positional  information  about  the  features(obtained 
from  the  relaxation  labeling)  and  the  knowledge  base 
of  mesoscale  information. 


This  paper  presents  a  relaxation  labeling  scheme 
to  label  features  in  thermal  infrared  images  obtained 
front  satellite.  The  technique  presented  in  this  paper 
exploits  the  advantages  of  using  the  contextual  infor¬ 
mation  in  the  labeling  algorithm.  'lire  remainder  of 
the  paper  is  organized  as  follows:  Section  3.0  intro¬ 
duces  the  probabilistic  relaxation  scheme  and  brieilv 
discusses  the  application  of  this  scheme  to  the 
oceanographic  labeling  problem.  In  section  4.0  we 
develop  a  mathematical  frame  work  which  is  neces¬ 
sary  for  our  labeling  problem.  Section  5.0  discusses 
the  performance  of  our  technique  and  describes  the 
steps  that  are  involved  in  implementing  this  tech¬ 
nique.  Section  6.0  gives  a  brief  description  on  the 
implementation  of  this  technique  on  the  image 
analysis  system  at  NORDA.  Section  7.0  concludes 
with  all  the  important  features  of  this  technique  and 
future  extensions  to  the  available. scheme. 
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3.0  RELAXATION  PROCESS 
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An  important  research  area  in  image  analysis  and 
jimme  interpretation  technology  is  the  development 
of  methods  that  blend  contextual  information  with 
the  conventional  image  processing  algorithms.  The 
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literature  survey  clearly  indicates  that  such  a  hybrid 
approach  yields  good  results.  Relaxation  labeling  is 
one  such  process  that  approaches  this  problem. 
Relaxation  labeling  has  been  applied  to  a  variety  of 
image  processing  problems  eg.,  linear  feature 
enhancement  [8],  edge  enhancement  [9],  image 
enhancement  [10),  pixel  classification  1 11,12). 
Recently  a  survey  article  by  Kitten  and  Illingworth 
[13]  on  relaxation  labeling  highlights  the  importance 
of  this  area  of  research.  The  survey  [13)  also  points 
out  the  advantages  and  possible  applications  of  relax¬ 
ation  methods.  More  importantly,  the  relaxation 
labeling  approach  was  elegantly  described  by  Rosen- 
feld  et  al.  [14]  who  investigated  die  problem  of  label¬ 
ing  the  sides  of  a  triangle  and  proposed  a  set  of 
schemes  to  solve  the  problem.  The  paper  [14)  con¬ 
cluded  with  the  result  that  the  non  linear  probabilistic 
relaxation  schemes  yield  better  results  than  the  oth¬ 
ers.  The  labeling  algorithm  presented  in  this  paper  is 
based  on  the  non  linear  probabilistic  relaxation  tech¬ 
nique. 

The  goal  of  the  relaxation  process  is  to  reduce 
the  uncertainty  (and  improve  the  consistency)  in  the 
assignment  of  one  of  the  labels  to  each  object  in  a  set 
of  related  objects.  In  the  Oceanographic  feature 
classification  problem,  the  classes  are  the  various 
Oceanographic  features  namely  North  and  South  wall 
of  Gulf  Stream,  cold  eddy,  warm  eddy,  shelf  front 
and  coastal  boundary.  Refer  to  fig. 2  to  identify  the 
position  of  these  oceanic  features  in  a  typical  image. 
The  objects  are  the  individual  pixels  in  a  set  of 
registered  multi-temporal  images.  The  uncertainty 
could  be  due  to  the  cloud  cover  or  the  overlap  of  the 
features  that  are  mentioned  above,  features  not 
belonging  to  one  of  the  classes,  noise  in  the  image,  or 
other  factors.  In  this  paper,  we  are  attempting  to  label 
mesoscale  features,  but  the  ocean  exhibits  variability 
on  all  spatial  scales.  Thermal  structure  on  scales 
smaller  than  mesoscale  will  interfere  with  the  mesos¬ 
cale  feature  labeling  process.  The  underlying 

mathematical  framework  necessary  for  the  relaxation 
labeling  method  is  described  in  the  next  section  of 
the  paper. 


4.0  MA THKMATICAL  FRAMEWORK 

Let  A  =  ( X, ,A-2  Xm  )  be  the  set  of  possible  labels  that 
may  be  assigned  to  each  pixel  x  in  the  IR  image 
Also  we  let  p[(x,t)  denote  the  probability  that  the 
pixel  at  x(i,j)  and  time  instant  f,  belongs  to  the  object 
X  after  k  iterations  of  the  relaxation  algorithm.  Note 


that  the  probabilities  are  functions  of  time  unlike  the 
conventional  pixel  relaxation  labeling  schemes  where 
the  probability  is  a  function  of  position  alone.  This 
allows  the  relaxation  labeling  algorithm  to  utilize 
temporal  continuity  to  reduce  the  ambiguity  in  label¬ 
ing.  'Hie  ambiguity  may  arise  due  to  noise  (cloud 
cover,  for  example). 


There  are  two  steps  in  executing  the  probabilistic 
relaxation  algorithm.  At  the  first  step,  a  priori  proba¬ 
bilities  are  evaluated  with  the  help  of  ground  truth 
data  and  /  or  a  previous  but  recent  mesoscale 
analysis.  In  the  second  step,  these  a  priori  probabili¬ 
ties  are  iteratively  updated  (relaxation)  until  a  con¬ 
sistent  labeling  is  reached.  We  now  discuss  these  two 
steps  in  detail. 


Step  1:  Estimating  the  a  priori  probabilities 


Let  p\(x,t)  denote  the  a  priori  value,  that  is,  the  pro¬ 
bability  that  pixel  x(ij)  at  time  t  belongs  to  the  object 
X,  at  the  zeroth  iteration.  The  Bayesian  probability 
equation  is  used  to  evaluate  this  value.  The  equation 
(4.1)  is  used  to  calculate  p"(x  ,t ). 


rH<x.  t)  = 


p(x  ,t  Ik)  P(X) 
£x  pix.i  IX)  P(\) 


(4.1) 


where  p(x.i  iX)  denote  the  conditional  density  function 
and  P(X)  the  probability  of  occurrence  of  the  object  X. 

To  evaluate  the  conditional  density  function  p(xj  IX), 
a  set  of  parameters  is  measured  at  the  pixel  x(i  j).  Let 
X  denote  the  parameter  vector.  The  following  param¬ 
eters  are  used  to  form  the  vector  X: 

(1)  distance  of  the  pixel  x(ij)  from  the  origin,  both 
the  magnitude  and  direction. 

(2)  gray  scale  intensity  value  at  the  pixel  x(i  j). 

(3)  the  edge  magnitude  (Section  5.1  presents  the 
chosen  edge  operator  algorithm). 

For  each  object,  the  mean  vector  ux  and  the  covari¬ 
ance  matrix  lx  are  computed.  Also  it  is  assumed  that 
the  conditional  density  function  follows  a  normal  dis¬ 
tribution.  Hence  the  conditional  density  function 
p(x.t  IX)  is  evaluated  using  equation  (4.2). 


/>( 


x  .1  lX)  =  (2KlIjjr'/1cxpj  -  j  (.V-ux)'^'(X-Ux)}  (4.2) 
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To  compute  P(X)  ,  relative  areas  of  the  objects  are 
considered.  The  number  of  pixels  in  the  object  X  be 
n\-  Then  /JtX)  can  be  calculated  using  equation  (4.3). 


cov  (X,X ) 
c(X)  a(X ) 


where  c»v(X,X)  denotes  the  covariance  of  two  events, 
n  namely,  the  pixel  x  is  assigned  die  label  X  and  die 

P'X)-  vp  (4.3)  pixel  y  is  assigned  die  label  X  and  is  given  as: 


Step  2:  Iterative  updating  algorithm 

We  now  discuss  the  probability  updating  rule.  The 
new  estimate  of  the  probability  of  X  at  x(ij)  is  given 
by  (4.4). 


w,  ,  P\(x.i)0+qi(x)) 

t'l  (x.t)  =  ax - ; - , - 

Zip{(x,[)(l+qi(x )) 


+  (l-ajj />*(.<:/ (4.4) 


an  (X,X)  =  p{X&  X)  -  p(X)p(X )  (4.7) 


The  joint  probability  p(X&X)  can  be  calculated  using 
the  position  vectors  of  die  pixels  x  and  y.  Let  m  and 
in’  be  the  mean  position  vectors  of  the  objects  X  and 
X  respectively.  Then  die  joint  probability  can  be 
computed  using  simple  functions  as  given  by  equa¬ 
tions  (4.8a)  and  (4.8b). 


where  q{ u;  is  called  the  update  factor  and  ak  is  called 
temporal  weighting  function. 

The  method  of  estimating  these  factors  are  illustrated 
below.  The  updating  factor  for  the  estimate  p{(x.t )  at 
the  Xth  iteration  is  given  by  equation  (4.5). 


p  (k  Sc  X)  = 


v  -  x 


if  X  *  X  (4.8a) 


p(X  <£  X)  =  1  - 


x  +  tn 


if  X  =  X  (4.8b) 


q  *  (X  ]  =  m  Iy  Zyr  >x<X  '-v  )/;  x  (-v  1 


(4.5)  The  new  estimate  of  the  probability  of  X  at  \(ij)  is  : 


where  m  is  the  number  of  objects.  In  this  equation, 
r\\ix.y)  denote  compatibility  coefficients.  These 
coefficients  arc  computed  as  in  1 13,16],  According  to 
the  relaxation  scheme,  r^u.y)  is  a  measure  of  the 
probabilistic  compatibility  between  label  X  on  point  ,v 
and  label  X'  on  point  y,  and  has  the  following  charac¬ 
teristics: 

1 1 )  If  X  on  a:  frequently  co-occurs  with  X'  on  y,  then 
rw(x.y)  >  0  ,  and  if  they  always  co-occur,  then 
rxx(x.y)  =  1. 

(2)  If  3  on  x  rarely  co-occurs  with  X  on  v,  then 
ru<x.y)  <  0  ,  and  if  they  never  co-occur,  then 

r>j,<.x,y)  =  -1. 

(3)  If  X  on  x  occurs  independently  of  X  on  y,  then 

ru.<x’y)  =  0- 

These  compatibility  coefficients  are  computed  using 
the  equation  (4.6). 


/ 


<  ,n  =  «* 


pUx  .Q(l-*-v*un 
ZipU X  .1 1  <  h 


1 1  -aJpK(x/  (4.9) 


where  p\(xf)  denotes  the  probability  value  at  the 
pixel  x(ij)  at  time  instm-  t’ ,  t'  <  t  and  ax  denotes  the 
temporal  weighting  .unction  for  the  object  X.  The 
function  ak  determ'.ics  the  weight  that  is  given  to  the 
current  probability  values  and  the  factor  ( 1  -a-j  associ¬ 
ates  a  weight  to  the  probability  values  calculated  at 
previous  time  instant  t'. 

T  estimate  the  new  probability  value,  either  (a) 
the  probability  value  at  the  previous  time  frame  t'  or 
(b)  a  set  of  probability  values  at  time  frames  t‘ .  i" . 
:  "  etc.,  can  be  used.  In  the  present  analysis  and  the 
implementation,  the  method  (a)  is  chosen.  Also  it  is 
proposed  to  implement  the  method  (b)  and  compare 
improvements  (if  any)  in  the  feature  labeling.  The 
temporal  weighting  function  can  be  determined  with 
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the  help  of  the  previous  analysis  of  the  images.  It  is 
mulet  stood  that  this  temporal  weighting  function  can 
not  be  constant  in  the  real  time  situation.  For  example 
in  some  cases,  the  performance  of  the  labeling  may 
be  less  satisfactory  and  correspondingly  the  temporal 
weighting  function  should  be  given  a  relatively 
smaller  value.  Hence  the  selection  of  this  function 
itself  may  be  a  problem  in  some  cases.  One  may  use 
different  values  for  this  function  and  the  performance 
ol  the  labeling  can  be  compared.  'Hie  iterative  updat¬ 
ing  is  iemiinated  when  the  difference  between  the 
probability  values  at  the  k  th  and  the  (k  +  / >  th 
iterations  is  very  small  (say  less  than  0.1  %). 

5.0  DISCUSSION  ON  THE  TECHNIQUE 

The  implementation  of  the  above  mentioned 
technioue  is  earned  out  in  two  stages.  The  flow  chart 
shown  in  fig. 4  depicts  the  various  steps  involved  in 
implementing  the  technique. 


At  the  first  stage,  the  a  priori  probabilities  are 
estimated  using  a  manually  prepared  mesoscale 
analysis  from  a  time  period  of  five  days  prior  to  the 
test  image. 

The  objects  present  in  the  oceanographic  IR 
image  are  identified  with  the  help  of  the  previous 
analysis.  The  shapes  for  boundaries)  of  these  objects 
arc  then  determined  and  represented  by  a  regular 
polygon.  The  parameter  values  are  then  computed  for 
all  the  pixels  inside  these  polygons.  A  reasonably 
accurate  algorithm  which  finds  out  whether  a  pixel  is 
inside  a  polygon  or  not  is  implemented. 

From  the  parameter  vector  X  for  a  pixel  x(ij), 
the  mean  vector  is  calculated.  Also  for  each  object 
>.  ,  the  covariance  matrix  Ej,  is  computed.  The  equa¬ 
tion  (4.2)  is  used  to  compute  the  conditional  density 
function  p{ x.rlX).  Finally  the  initial  probability 
p"<x.n  is  computed  using  the  equation  (4.1).  The 
output  of  the  lirst  stage  is  shown  in  fig. 3.  The  output 
image  is  split  into  six  parts  to  illustrate  the  labeling. 
Fig. 3.1  shows  the  output  of  the  labeling  module  with 
all  the  live  features  labeled.  Refer  to  fig. 2  to  compare 
the  labeling  with  the  hand  segmented  image.  To  illus¬ 
trate  the  labeling  process  five  different  features  are 
considered.  They  arc  :  two  parts  of  the  north  wall, 
south  wall  and  two  warm  eddies.  The  labeling  of 
these  five  features  is  shown  in  figures  3.2  to  3.6.  The 


individual  pixels  in  the  oceanographic  image  are 
labeled  depending  on  the  initial  probability  values 
obtained  in  the  first  stage. 

5.1  DISCUSSION  ON  CLUSTER  SHADE  EDGE 

ALGORITHM 

In  this  section,  we  discuss  the  features  of  the 
edge  detection  algorithm  proposed  by  Holycr  and 
Peckinpaugh  [7).  'Hie  motivation  behind  the  develop¬ 
ment  of  such  a  new  edge  detector  algorithm  is  to  aid 
the  analysis  of  oceanographic  satellite  images.  The 
popular  derivative-based  edge  operators  viz  Sobel’s 
operator  [19]  are  shown  to  be  too  sensitive  to  edge 
fine-structure  and  to  weak  gradients  to  be  useful  in 
this  application.  The  edge  algorithm  proposed  by 
Holyer  and  Peckinpaugh  [7]  is  based  on  the  cluster 
shade  texture  measure,  which  is  derived  from  the 
gray  level  co-occurrence  matrix  (GLC).  The  authors 
1 7 J  have  suggested  that  the  edge  detection  technique 
based  on  the  GLC  matrix  can  be  effectively  used  in 
automated  detection  of  mesoscale  features.  The  (i.j) 
th  element  of  the  GLC  matrix  ,  P  (i  J  l  Ax  Ay )  is  the 
relative  frequency  with  which  two  image  elements, 
separated  by  distance  (At, Ay)  occur  in  the  image,  one 
with  intensity  level  i  and  the  other  with  intensity  level 
j.  The  elements  of  the  GLC  matrix  could  be  com¬ 
bined  in  many  different  ways  to  give  a  single  numeri¬ 
cal  value  that  would  be  a  measure  of  the  edges 
present  in  the  image.  Holyr  and  Peckinpaugh  [7] 
have  used  a  cluster  shade  function  which  is  found  to 
be  very  effective  in  the  edge  detection  process.  The 
new  edge  algorithm  computes  the  cluster  shade  func¬ 
tion  at  each  pixel.  Then  the  edges  are  detected  by 
finding  the  significant  zero  crossings  in  the  cluster 
shade  image.  The  advantages  of  this  new  edge  algo¬ 
rithm  over  the  conventional  derivative-based  tech¬ 
niques  are  discussed  in  [7].  It  is  known  that  using 
large  windows  in  derivative-based  edge  detector 
algorithms  results  in  poor  smoothing.  This  problem  is 
circumvented  in  the  new  algorithm.  Because  edges 
are  detected  by  finding  zero  crossings,  precisely  posi¬ 
tioned  lines  result,  even  if  the  GLC  matrix  is  calcu¬ 
lated  using  a  larger  window.  So,  the  desired  edge 
detection  characteristics  of  retaining  sharp  edges 
while  eliminating  edge  detail  is  achieved  with  the 
help  of  the  new  algorithm.  As  an  input  to  our  feature 
labeling  algorithm,  w'e  used  the  image  output 
generated  by  cluster  shade  algorithm,  with  a  window 
size  of  16x16  pixels  and  zero  crossing  threshold  of 
50.  The  edge  magnitudes  obtained  from  this  new 
edge  detector  algorithm  is  used  as  an  input  to  the 
feature  labeling  algorithm.  In  particular  the  edge 
magnitudes  are  used  to  evaluate  the  a  priori  probabil- 
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ity  values.  It  can  be  seen  from  tig  3.  that  the  only  the 
edge  pixels  participate  actively  in  the  labeling  pro¬ 
cess.  Also  the  speed  of  the  algorithm  that  computes 
the  a  priori  probability  values  is  greatly  improved 
because  of  the  reduced  number  of  pixels  for  con¬ 
sideration. 

In  the  second  stage,  the  iterative  updating  rule  is 
implemented.  The  compatibility  coefficients  are 
evaluated  using  the  equation  (4.6).  The  coefficients 
are  calculated  using  the  initial  class  probability 
values  obtained  in  the  first  stage.  These  are  fixed  dur¬ 
ing  the  update  process.  As  a  concluding  step  in  the 
second  stage  of  the  implementation,  the  iterative 
updating  algorithm  is  implemented  using  the  equa¬ 
tion  (4.9).  The  iterative  algorithm  terminates  when 
(  n{tl  p[{x,t))  <  e  where  £  is  a  very  small 
quantity.  Clearly  the  time  parameter  is  helpful  in 
reducing  the  ambiguity,  especially  when  the  image  is 
Luntammated  with  noise. 


n  ti  IMPLEMENTATION 

In  this  section,  we  present  the  experimental 

-dts  of  the  first  stage  of  the  relaxation  labeling 
technique  estimating  the  a  priori  probability  values 
t  .t  reference  image.  'Hie  software  that  computes  the 
a  pnori  probabilities  is  developed  on  VAX  8300  sys¬ 
tem  running  the  VMS  operating  system  installed  at 
the  Remote  Sensing  Branch,  NORDA.  We  used  the 
Interactive  Digital  Satellite  Image  Processing  System 
consisting  of  International  Imaging  System’s  S600 
software  with  NORDA  extensions  to  process  the 
oceanographic  satellite  images.  The  software 
modules  are  developed  in  ’C’  language.  The  posi¬ 
tional  information  about  the  oceanographic  features 
present  in  the  image  can  be  provided  either  manually 
or  from  the  previous  analysis  of  the  satellite  imagery 
data.  The  module  first  computes  the  mean  vectors 
and  covariance  matrices  for  all  the  objects  present  in 
the  reference  image.  'Die  second  part  of  the  software 
module  computes  the  a  priori  probability  values  as 
given  by  equation  (4.1 ). 

To  illustrate  the  performance  of  the  labeling 
algorithm,  an  oceanographic  infrared  image  with 
some  of  the  typical  oceanic  features  is  taken  (refer  to 
lig.l).  The  objects  that  are  selected  for  labeling  tire 
north  wall,  south  wal  1  and  warm  eddies.  'Die  a  priori 
knowledge  about  the  objects,  namely  the  position  is 
taken  from  the  prior  analysis  shown  in  fig. 3  and 
given  a s  an  input  to  the  labeling  module.  Ilic  a  priori 
probability  values  tire  then  computed  for  all  the  pis 


els  present  in  the  image.  To  highlight  the  perfor¬ 
mance  of  this  initial  labeling  algorithm,  a  decision 
making  algorithm  based  on  these  a  priori  probability 
values  is  implemented.  A  pixel  that  has  a  probability 
value  above  0.8  for  an  object  is  given  the  label  for 
that  object.  The  decision  algorithm  selects  the  pixels 
m  the  neighborhood  of  the  objects  to  illustrate  the 
results  obtained.  The  edges  of  the  labeled  objects  are 
dilated  for  clear  identification  of  the  labels.  The 
covariance  matrices  for  the  objects  are  shown  in 
fig. 5. 


7.0  SUMMARY  AND  RECOMMENDATIONS 
FOR  FUTURE  WORK 

In  this  paper,  the  need  for  automatic  interpreta¬ 
tion  of  oceanographic  images  is  emphasized.  The 
advantage  of  exploiting  the  contextual  information  in 
feature  labeling  is  highlighted.  An  efficient  and  sim¬ 
ple  technique  for  labeling  of  oceanic  features  is 
described.  'Die  underlying  theoretical  framework  and 
functions  are  explained  in  detail.  Results  of  the  first 
stage  of  the  labeling  technique  are  presented.  The 
results  and  the  performance  analysis  of  the  proceed¬ 
ing  stages  of  the  technique  will  appear  in  forthcom¬ 
ing  issues.  TTie  first  stage,  namely,  the  estimation  of  a 
priori  probabilities  for  the  reference  image,  is  com¬ 
plete  and  has  been  tested  on  real  oceanographic 
images.  An  expert  system  that  uses  the  knowledge 
base  and  the  information  obtained  from  the  labeling 
algorithm  is  in  the  process  of  development. 

As  a  future  extension  to  the  present  work  we 
propose  to  : 

(i)  investigate  the  possibility  of  implementing  a 
parallel  relaxation  labeling  algorithm  to  speed  up 
the  labeling  process. 

(ii)  make  the  oceanographic  expert  system  "learn'' 
from  its  past  experience  in  analyzing  the  satellite 
imagery  data. 

(iii)  incorporate  additional  infonnation  about  the 
inesoscale  features  (size,  physical  properties, 
etc.)  during  the  labeling  process  to  reduce  the 
ambiguity  m  labeling  the  features. 
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Iig.1  sample  IR  image 
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lig.2  hand  segmented  image 


fig. 3.1  labeled  image 


fip.4  algorithm  to  find  apriori  probabilities 


fig-3.2 

-  3.6  individual  features  labeled 
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fig. 5  covariance  matrices 


